Reinforcement learning control of robot manipulator

نویسندگان

چکیده

Since the establishment of robotics in industrial applications, robot programming involves therepetitive and time-consuming process manually specifying a fixed trajectory, which results machineidle time terms production necessity completely reprogramming for different tasks.The increasing number applications unstructured environments requires not only intelligent butalso reactive controllers, due to unpredictability environment safety measures respectively. This paper presents comparative analysis two classes Reinforcement Learning algorithms, value iteration (Q-Learning/DQN) policy (REINFORCE), applied discretized task positioning robotic manipulator an obstacle-filled simulated environment, with no previous knowledge obstacles’ positions or arm dynamics. The agent’s performance algorithm convergence are analyzed under reward functions on four increasingly complex test projects: 1-Degree Freedom (DOF) robot, 2-DOF Kuka KR16 Industrial random setpoint/obstacle placement. DQN presented significantly better reduced training across all projects third function generated agents both algorithms.

برای دانلود باید عضویت طلایی داشته باشید

برای دانلود متن کامل این مقاله و بیش از 32 میلیون مقاله دیگر ابتدا ثبت نام کنید

اگر عضو سایت هستید لطفا وارد حساب کاربری خود شوید

منابع مشابه

Reinforcement Learning for Multi - Linked Manipulator Control

We present an automatic trajectory planning and obstacle avoidance method for a multi-linked manipulator which uses position and velocity sensor information directly to produce the appropriate real-valued torques for each joint. The inputs are fed into a Cerebellar Model Arithmetic Computer (CMAC) [1] and in each state, the expected reward and torques for each joint are learnt through self-expe...

متن کامل

Learning Control of Motion for Robot Manipulator

Given a desired output for a class of dynamical systems, certain kinds of iterative learning control are shown to be effective in the sense that the output converges to the desired one with repeating operations. One of those methods can be applied to a robot manipulator with high nonlinearities even though its physical parameters are not known. In this case, the velocity vector of the robot mot...

متن کامل

Reinforcement learning for robot control

Writing control code for mobile robots can be a very time-consuming process. Even for apparently simple tasks, it is often difficult to specify in detail how the robot should accomplish them. Robot control code is typically full of “magic numbers” that must be painstakingly set for each environment that the robot must operate in. The idea of having a robot learn how to accomplish a task, rather...

متن کامل

Learning Inverse Dynamics for Robot Manipulator Control

Model-based control strategies for robot manipulators can present numerous performance advantages when an accurate model of the system dynamics is available. In practice, obtaining such a model is a challenging task which involves modeling such physical processes as friction, which may not be well understood and difficult to model. Furthermore, uncertainties in the physical parameters of a syst...

متن کامل

Hierarchical Reinforcement Learning in Robot Control

The use of reinforcement learning in robotics suffers greatly from the curse of dimensionality, stemming from the necessity of a high DOF in a robot to solve even the simplest tasks. This paper gives an overview over several attempts to decrease this problem using a hierarchical structure of reinforcement learning, an evaluation of the problems that arise with such approaches and possible solut...

متن کامل

ذخیره در منابع من


  با ذخیره ی این منبع در منابع من، دسترسی به آن را برای استفاده های بعدی آسان تر کنید

ژورنال

عنوان ژورنال: Revista Brasileira de Computação Aplicada

سال: 2021

ISSN: ['2176-6649']

DOI: https://doi.org/10.5335/rbca.v13i3.12091